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Abstract. We initiate the study of limit shapes for random permutations avoiding a given 
pattern. Specifically, for patterns of length 3, we obtain delicate results on the asymptotics 
of distributions of positions of numbers in the permutations. We view the permutations as 
0-1 matrices to describe the resulting asymptotics geometrically. We then apply our results 
to obtain a number of results on distributions of permutation statistics. 



Introduction 

The Catalan numbers is one of the most celebrated integer sequences, so much that it is hard to 
overstate their importance and appUcability. In the words of Thomas Koshy, "Catalan numbers 
are [..] fascinating. Like the North Star in the evening sky, they are a beautiful and bright light 
in the mathematical heavens." Richard Stanley called them "the most special" and his "favorite 
number sequence" |Kimj . To quote Martin Gardner, "they have the delightful propensity for 
popping up unexpectedly, particularly in combinatorial problems" |Gar| . In fact, Henry Gould's 
bibliography fGou| lists over 450 papers on the subject, with many more in recent years. 

Just as there are many combinatorial interpretations of Catalan numbers [Sll Exc. 6.19] (see 
also |P2 | ISlo| [S2]). there are numerous results on statistics of various such interpretations (see 
e.g. |B2[|S1| ). as well as their probabilistic and asymptotic behavior (see [Drm llFS] ). The latter 
results usually come in two flavors. First, one can study the probability distribution of statistics, 
such as the expectation, the standard deviation and higher moments. The approach we favor 
is to define the shape of a large random object, which can be then analyzed by analytic means 
(see e.g. [All IVer| IVKj ). Such objects then contain information about a number of statistics, 
under one roof. 

In this paper we study the set iS„(7r) of permutations a € Sn avoiding a pattern n. This 
study was initiated by Percy MacMahon and Don Knuth, who showed that the size of 5„(7r) is 
the Catalan number C„, for all permutations it G S3 jKnui iMac] . These results opened a way 
to a large area of study, with numerous connections to other fields and applications |Kitj (see 



also Subsection 9.2 1 



We concentrate on two classical patterns, the 123- and 132-avoiding permutations. Natural 
symmetries imply that other patterns in 5*3 are equinumerous with these two patterns. We 
view permutations as 0-1 matrices, which we average, scale to fit a unit square, and study the 
asymptotic behavior of the resulting family of distributions. Perhaps surprisingly, behavior of 
these two patterns is similar on a small scale (linear in n) , with random permutations approxi- 
mating the reverse identity permutation (n, n — 1, . . . , 1). However, on a larger scale (roughly, 
on the order n" away from the diagonal), the asymptotics of shapes of random permutations 
in 5„(123) and iS„(132), are substantially different. This explains, perhaps, why there are at 
least nine different bijections between two sets, all with different properties, and none truly 



"ultimate" or "from the book" (see Subsection 9.31 



Our results are rather technical and contain detailed information about the random pat- 
tern avoiding permutations, on both the small and large scale. We exhibit several regimes 
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(or "phases"), where the asymptotics are unchanged, and painstakingly compute the precise 
hmits, both inside these regimes and at the phase transitions. QuaHtatively, for 123-avoiding 
permutations, our results are somewhat unsurprising, and can be explained by the limit shape 



results on the brownian excursion (see Subsection 9.7); still, our results go far beyond what was 



known. However, for the 132-avoiding permutations, our results are extremely unusual, and 



have yet to be explained even on a qualitative level (see Subsection 9.8). 

The rest of the paper is structured as follows. In the next section we first present examples 
and calculations which then illustrate the "big picture" of our results. In Section [2] we give 
formal definitions of our matrix distributions and state basic observations on their behavior. 
We state the main results in Section [Sj in a series of six theorems of increasing complexity, for 
the shape of random permutations in 5„(123) and iS„(132), three for each. Sections |4] and [S] 
contain proofs of the theorems. In the next three sections (sections [6j[7] and [s]), we give a long 
series of corollaries, deriving the distributions for the positions of 1 and n, the number and 
location of fixed points, and the generalized rank. We conclude with final remarks and open 
problems (Section |9]) . 

1. The big picture 

In this section we attempt to give a casual description of our results, which basically makes 
this the second, technical part of the introduction]^ 

1.1. The setup. Let f„(j, fc) and Q„(j, fc) be the number of 123- and 132-avoiding permu- 
tations, respectively, of size n, that have j in the fc-th position. These are the main quantities 
which we study in this paper. 

There are two ways to think of _P„(-, •) and (5„(-, •). First, we can think of these as families 
of probability distributions 

T^Pnij,-), J^Pn{-,k), J^QnUr), and -^Q„(-,fc). 

(-^n '-•71 '-•n L^n 

In this setting, we find the asymptotic behavior of these distributions, where they are con- 
centrated and the tail asymptotics; we also find exactly how they depend on parameters j 
and k. 

Alternatively, one can think of P„(-, •) and Qn(-, •) as single objects, which we can view as a 
bistochastic matrices: 

P« - ^ E ^'^('^)' Qn = ^ E ^^('^)' 

" <jg5(123) " cre5(132) 

where M((t) is a permutation matrix of cr S Sn- This approach is equivalent to the first, but 
more conceptual and visually transparent, since both P„ and Q„ have nice geometric asymptotic 
behavior when n — )■ oo. See Subsection 19. II for more on this difference. 

Let us present the "big picture" of our results. Roughly, we show that both matrices P„ 
and Q„ are very small for (j, k) sufficiently far away from the anti-diagonal 

A = {{j,k) \ j + k = n + l}, 

and from the lower right corner (n, n) in the case of Q„. However, already on the next level of 
detail there are large differences: P„ is exponentially small away from the anti-diagonal, while 
Q„ is exponentially small only above A, and decreases at a rate 8(n~'^/^) on squares below A. 

At the next level of detail, we look inside the "phase transition" , that is what happens when 
(j, k) are near A. It turns out, matrix P„ maximizes at distance Q{^/n) away from A, where 
the values scale as 8(n~^/^), i.e. much greater than average 1/n. On the other hand, on the 
anti-diagonal A, the values of P„ scale as 8(n~'^/^), i.e. below the average. A similar, but much 
more complicated phenomenon happens for Q„. Here the "phase transition" splits into several 
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phases, with different asymptotics for rate of decrease, depending on how the distance from 
{j,k) to A relates to e(v^) and e{n^^^) (see Section[3|. 

At an even greater level of detail, we obtain exact asymptotic constants on the asymptotic 
behavior of P„ and Q„, not just the rate of decrease. For example, we consider P„ at distance 
8(n^/^+^) from A, and show that P„ is exponentially small for all £ > 0. We also show that 
below A, the constant term implied by the 8 notation in the rate Q{n~^^^) of decrease of Q„, 
is itself decreasing until "midpoint" distance n/2 from A, and is increasing beyond that, in a 
symmetric fashion. 

Unfortunately, the level of technical detail of our theorems is a bit overwhelming to give a 
casual description; they are formally presented in Section [Sj and proved in sections Hlandjsj The 
proofs rely on explicit formulas for k) and Qn{j, k) which we give in lcmmas |4.2| and |5.3[ 
These are proved by direct combinatorial arguments. From that point on, the proofs of the 
asymptotic behavior of P„ and Q„ are analytic and use no tools beyond Stirling's formula and 
the Analysis of Special Functions. 



1.2. Numerical examples. First, in figures 11 and 12 we compute the graphs of P250 and Q 



^250 



(see the Appendix). Informally, we name the diagonal mid-section of the graph of P250 the 
canoe; this is the section of the graph where the values are the largest. Similarly, we use the 
wall for the corresponding mid-section of Q250 minus the corner spike. The close-up views of the 
canoe and the wall are given in figures [13] and [l4j respectively. Note that both graphs here are 
quite smooth, since n — 250 is large enough to see the the limit shape, with C250 ~ 4.65 x 10""^^^, 
and every pixelated value is computed exactly rather than approximated. 

Observe that the canoe is symmetric across both the main and the anti-diagonal, and contain 
the high spikes in the corners of the canoe, both of which reach 1/4. Similarly, the wall is 
symmetric with respect to the main diagonal, and has three spikes which reach 1/4. These 
results are straightforward and proved in the next section. 

To see that the canoe is very thin, we compare graphs of the diagonal sections Pn{k, k)/Cn 
for n — 62, 125,250 and 500, as k varies from 90 to 160 (see figures [t] to 10 in the Appendix). 
Observe that as n increases, the height of the canoes decreases, and so does the width and the 
"bottom". As we mentioned earlier, these three scale as 8(n~^/^), Q{n^'^^^), and 8(n~'^/^), 
respectively. Note also the sharp transition to a near fiat part outside of the canoe; this is 
explained by an exponential decrease mentioned earlier. The exact statements of these results 
are given in Section [3] 

Now, it is perhaps not clear from Figure [l3] that the wall bends to the left. To see this 
clearly, we overlap two graphs in Figure [I] Note that the peak of P25o(fc, k) is roughly in the 
same place of Q25o{k, k), i.e. well to the left of the midpoint at 125. The exact computations 
show that the maxima occur at 118 and at 119, respectively. Note also that Q25o{k,k) has a 
sharp phase transition on the left, with an exponential decay, but only a polynomial decay on 
the right. 



1.3. Applications. We mention only one statistic which was heavily studied in previous years, 
and which has a nice geometric meaning. Permutation a is said to have a fixed point at k if 
(j{k) ~ k. Denote by fp((T) the number of fixed points in a. 

For random permutations a £ Sm the distribution of fp is a classical problem; for example 
E[fp] = 1 for all n. In an interesting paper ^RSZ^, the authors prove that the distribution of fp 
on 5(321) and on 5(132) coincide (see also |E2i lEPj ). Curiously, Elizalde used the generating 
function technique to prove that E[fp] = 1 in both cases, for all n, see |E1| . He also finds closed 
form g.f. formulas for the remaining two patterns (up to symmetry). 

Now, the graphs of F„(fc, fc)/C„ and Qn{k,k)/Cn discussed above, give the expectations 
that fc is a fixed point in a pattern avoiding permutation. In other words, fixed points of 
random permutations in 5„(123) and 5„(132) are concentrated under the canoe and under the 
wall, respectively. Indeed, our results immediately imply that w.h.p. they lie near n/2 in both 
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-P1250,k,k)/Cj5„ 
-Q(250,k,k)/Cj5g 



Figure 1. Comparison of P25o{k,k)/C'25a and Q25a{k, k)/C2, 



50- 



cases. For random permutations in 5„(321) and 5„(231), the fixed points lie in the ends of the 
canoe and near the corners of the wall, respectively. In Section[7j we qualify all these statements 
and as a show of force obtain sharp asymptotics for E[fp] in all cases, both known and new. 



2. Definitions, notations and basic observations 
2.1. Asymptotics. Throughout this paper we use f{n) ^ g{n) to denote 

fin) 



lim 

n^oo g[n) 



1 



We use f{n) — 0{g{n)) to mean that there exists a constant M and an integer N such that 

|/(n)| < M \g{n)\ for aU n> N. 

Also, f{n) — Q{g{Ti)) denotes that /(n) = 0{g{n)) and g{n) = 0{f{n)). Similarly, f{n) 
o(g{n)) is defined by 



Recall Stirling's formula 



lim 44=0- 



'2TTn 



We use C„ to denote the n-th Catalan number: 

1 /2n^ 



n + 1\ n 



, and Cn 



2.2. Pattern avoidance. Let n and m be positive integers with m < n, and let 

and pattern r = (r(l), r(2), . . . , r(m)) S Sm- We say that a contains r if there exist in- 
dices ii < 12 <■■■< im such that (cr(«i), (7(12), . . . , cr(im)) is in the same relative order as 
(t(1),t(2), . . . ,t(to)). If a does not contain r then we say a is r-avoiding, or avoiding pat- 
tern T. In this paper we use only r g S3; to simplify the notation we use 123 and 132 to 
denote patterns (1,2,3) or (1,3,2), respectively. For example, a = (2,4,5,1,3) contains 132, 
since the subsequence (cr(l), ct(2), (7(5)) = (2, 4, 3) has the same relative order as (1, 3, 2). How- 
ever, a = (5,3,4,1,2) is 132-avoiding. 

Denote by 5„(7r) the set of tt- avoiding permutations in Sn. For the case of patterns of 
length 3, it is known that regardless of the pattern tt e S3, we have |iS„(7r)| = Cn ■ 

Theorem 2.1 (MacMahon, Knuth). For all tt e ^3, we have |S'„(7r)| = C„. 
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While the equalities |5„(132)| = |5„(231)| = |5„(213)| = |5„(312)| and |5„(123)| |5„(321)| 
are straightforward, the fact that |5„(132)| = |5„(123)| is more involved. 

2.3. Symmetries. Recall that P„(j, fc) and Qn{j,k) denote the number of permutations in 
5„(123) and 5„(132), respectively, of size n that have j in the fc-th position. In this section we 
discuss the symmetries of such permutations. 

Proposition 2.2. For all n,j,k positive integers such that 1 < j,k < n, we have Pn{j,k) ~ 
Pnik,j) and Qn{j,k) — Qn{k,j). Also, Pn{j,k) ^ Pn{n+ I — k,n + l — j), for all k, j as above. 

The proposition implies that we can interpret P„(j, fc) as either 

|{cr e 5„(123)s.t.cr0') = fc}| or |{(t G 5„(123) s.t. cr(A:) = j}|, 

and we use both formulas throughout paper. The analogous statement holds with Qn{j,k) as 
well. Note, however, that Qn{j, k) is not necessarily equal to Qnin + ^ — k,n + 1 — j); for 
example, (53(1,2) = 2 but (53(2,3) — 1. In other words, there is no natural analogue of the 
second part of the proposition for (5n(j, k), even asymptotically, as our results will show in the 
next section. 

Proof. The best way to see this is to consider permutation matrices. Observe that P„{j,k) 
counts the number of permutation matrices A = (a^s) which have Ukj = 1, but which have no 
row indices ii < i2 < is nor column indices ji < j2 < ja such that fli^jj = <^i2j2 — o-isjs = 1. 
If A is such a matrix, then B — A'^ is also a matrix which satisfies the conditions for Pn{k,j), 
since bjk = 1 and B has no indices which lead to the pattern 123. This transpose map is clearly 
a bijection, so we have Pn{j, k) — Pn{k,j). 

Similarly, since any 132 pattern in a permutation matrix A will be preserved in i? = , 
we have Qn{j, k) = Qn{k,j). Finally, observe that Pn{j, k) — Pn{n + ^ — k,n + 1 — j), since 
cr is 123-avoiding if and only if p = (rt + 1 — a{n), n + 1 — (t(?i — 1), . . . , n + 1 — cr(l)) is 
123-avoiding. □ 

2.4. Maxima and minima. Here we find all maxima and minima of matrices P„(-,-) and 
Qni', •)• We separate the results into two propositions. 

Proposition 2.3. For all n > 3, the value of Pn{j,k) is minimized when {j,k) = (1,1) or 
(n,n). Similarly, Pn{j,k) is maximized when 

(j, k) = (1, n), (1, n - 1), (2, n) or {n - 1, 1), (n, 1), (n, 2). 

Proof. For any n, the only a £ iS„(123) with (t(1) = 1 is (t = (1, n, n — 1, . . . , 3, 2). This implies 
that P„(l,l) = 1. Similarly, Pn{n,n) = 1, since the only such permutation is (n — l,n — 
2,...,2,l,n). 

For every j, k < n, the maximum possible value of Pniii k) is (7„-i, since the numbers from 
1 to 71 excluding j must be 123-avoiding themselves. Let us show that 

P„(l,n) - P„(2,n) = P„(l,n- 1) = C„^i, 

proving that this maximum is in fact achieved by the above values of j and k. 

If cr S iS„(123) has a{l) = n, then n cannot be part of a 123-pattern, since it is the highest 
number but must be the smallest number in the pattern. Therefore, any a G 5„_i(123) can be 
extended to a permutation r £ 5^(123) in the following way: let r(l) = n, and let r(i) = f7(z — 1) 
for 2 < i < n. Since |5„_i(123)| = Cn-i, we have P,i(l, n) — (7„_i. Similarly, if cr(2) = n, then 
n cannot be part of a 123-pattern, so P„(2, n) ~ Cn-i- The same is true if cr(l) = (n — 1), so 



P„(l,n — 1) = Cn-i- By Proposition 2.2 we also have 

Pn{n -1,1)= Pn{n, 1) = Pn{n, 2) = C„_i, 
as desired. □ 
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Proposition 2.4. For all n > 4, the value of Qn{j,k) is minimized when {j,k) — (1,1). 
Similarly, (j, k) is maximized when 

{j,k) ^ {l,n), {I, n- l),{n~ 1,1), {n, I), or {n,n). 

Proof. For {j,k) — (1,1), the only 132-avoiding permutation is cr = (1, 2, 3, . . . , n — l,n). 
Therefore, (5„(1, 1) = 1 for all n. 



For the second part, we use the same reasoning as in Proposition 2.3 except for (j, k) — [n, n). 
For {j,k) = (n,n), we have Qn{n,n) = Cn-i as well, since n in the final position cannot be 
part of a 132-pattern. Observe that unlike P„(2,n), Q„(2,n) < C„_i, since cr(2) = n retires 
a{l) = ri — 1, in order to avoid a 132-pattern. □ 



3. Main results 

3.1. Shape of 123-avoiding permutations. Let < a, 6 < 1, < a < 1, and c e M s.t. c^Q 

for a 7^ be fixed constants. Recall that P„(j, k) is the number of permutations a e 5„(123) 
with a{j) = k. Define 

n"^ PjJan ~ cn"^ , bn — cn") 
lim — < oo 



F{a, b, c, a) = sup <^ d £ 

Let 



, , n^^''^^^'^'°'')PJan- cn",bn- cn") 
L{a, b, c, a) = lim — , 

n-s-oo G,i 

defined for all a, b, c, a as above, for which F{a, b, c, a) < oo; let L be undefined otherwise. 
Theorem 3.1. For all < a,b < l,c eM. and < a < 1, we have 



F{a,b, 



c,a) = 



ifa + b^l, 

if a + b = 1, c ^ 0, a > \ 
2 i/a + 6= l,c = 0, 

I -2a if a + b=l, c^Q, a <\ 



3 



Here F{a,b,c,a) — oo means that P„(an — cn°' ,bn — en") — o(C„/rt'^), for all d > 0. The 
following result proves the exponential decay of these probabilities. 

Theorem 3.2. Let < a, 6 < 1 s.t. a + b ^ 1, c e M, and < a < 1. Then, for n large enough, 
we have 

Pn(an — en"" , bn — en"' ) 
^ < £ > 

where e = e{a,b,c,a) is independent of n, and < e < 1. Similarly, let < a < 1, c =/= 0, and 
^ < a < 1 . Then, for n large enough, we have 

Pn{an — cn°', (1 — a)n — cn") n^c-i 

where e = e(a, c, a) is independent of n and < e < 1. 

These theorems compare the growth of Pn{an — cn", bn — en") to the growth of C„. Clearly, 

n 

J2 PnU, k) = |5„(123)| = C„ for aU 1 < A: < n . 
Therefore, if Pn{j, k) = Pn if, s) for all j, k, r, and s, then we would have P„(j, k) =^ Cnjn for all 



1 < i, ^ < Theorem 3.1 states that for < a, & < 1, a+6 ^ 1, we have Pn{an, bn) — o(Cn/n'^), 
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for every d e ]R. For a + & = 1, we have P„(an, bn) = 0(C„/n2 ). Theorem 3.1 is in fact stating 
sHghtly more. When we consider P„(art — cn", bn — cn") instead of P„(a?i, bn), we have 

Pn{an - cn°',bn - cn") = 9 (c^/nt^^aj ^ 
for aU a < | . This relationship can be seen in figures [2] and [sj 



^:{a + b=l-±} 




Figure 2. Region where P„(an, bn) ^ Cn/n'^ for some d. 




7i:{a + 6=l-^} 

72 : {a + 6 = 1 — for some < a < 

73 : {a + & = 1} 



Figure 3. Region where Pn{an, bn) ^ Cn/n'^ for some d. 

In Figure [3j on 71, we have 

P„ (an — c\fn, (1 — a)n — c\fn) ~ 6 f — ^ ) . 



On 72, where 



we have 



2c , 1 

a + = 1 — , for some < a < - , 



Pn{an — cn"', (1 — a)n — cn") = 9 



On 73, we have P„(an, (1 — a)n) — 9(C,i/n2 ). Behavior is symmetric about the Hne a + b — 1. 

The foUowing result is a strengthening of Theorem |3.1| in a different direction. For a, b, c, 
and a as above, s.t. P(a, 6, c, a) < cx), we calculate the value of L(a, b, c, a). 
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Theorem 3.3. For all < a < l,c e R, and < a < 1/2, we have 

^(a, c) if c = or a = , 



L[a, 1 — a,c,a) — I rj{a, c) 



if c ^ and < a < | 



ri{a,c)K{a,c) if c ^ and a 



where 



C(a,c) 



(2c +1)2 



77(a, c) 



and K(a, c) — exp 



40r(a(l - a))5 ' " ' ' 0r(a(l-a))3 ' ' ' ' [a{l - a) 

Let us note that for a = or c = as in theorem, we actually evaluate 

Pn{an — cn°', (1 — a)n — erf + 1) rather than Pn{an — cn" , (1 — a)n — erf). 

We do this in order to ensure that we truly measure the distance away from the anti-diagonal 
where j + k — n + 1. This change only affects the asymptotic behavior of P„(-, •) when a = 
or c = 0. 



3.2. Shape of 132-avoiding permutations. Recall that Qn{j, k) is the number of permuta- 
tions a € 5„(132) with cr(j) = k. Let a, b, e and a be defined as in Theorem 3.1 Define 

i'^Qn{an — erf , hn — erf) 



Let 



G{a, b, c, a) — sup < d G 



AI(a, b, c, a) ~ lim 



lim 

n— f oo 



< oo 



defined for all a, b, c, a as above for which G(a, 6, c, a) < oo; M is undefined otherwise. 



Theorem 3.4. For < 


a,b < 1, c G Z and a 


> 0, we have 


G{a 


, 6,c, 


«) = 








oo 


i/ < a + 


6 < 1, 




oo if 


a4 


-6 = 


1, i < a < 1, 


c 


>o, 




3 
2 


j/ 1 < a + 


6 < 2, 




1 ^/ 


a4 


-6 = 


1, 0<«< |, 


c 


7^0, 




fa 


i/ a = b = 


1, < a < 1, c 7^ 0, 


< 


1 ^/ 


a4 


-6 = 


1: 1 <«< i 


c 


<o, 







if a = b = 


1, a = 0, 








-b = 


1, i < a < 1, 


c 


<o, 




3 
L 4 


if a + b = 


1, c = 0. 




J -2a z/ 


a4 


-b = 


1, i<«<i 


c 


> 0. 



As in Theorem 3.1 here G(a, b, c, a) = oo means that Qn{an — cTf , bn — crf) = o{Cn/n ), for 



all d > 0. The following result proves exponential decay of these probabilities (cf. Theorem 3.2 



Theorem 3.5. Let < a, 6 < 1 such that a + b < l,c^O, and < a < 1. Then, for n 
enough, we have 

Qn{an — erf , bn — cn") 



< 



where e = e(a,6, c, a) is independent of n, and < e < 1. Similarly, let < a < 1,0 < c, and 
^ < a < 1 . Then, for n large enough, we have 

Qn{an — cn"- , (1 — a)n — cn°') n^°"^ 

where e = e(a, c, a) is independent of n, and < e < 1. 

The above theorems compare the relative growth rates of Qnii,j) and C„, as n — )■ oo. 
Theorem 3.4 states that for a + 6 < 1, Qn{an, bn) = oiCnlrf) for all d > 0. For 1 < a -I- & < 2, 
we have 

Qn{an, bn) = 8 ' 
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Qn{a.n^hn) is the largest when a = 5 = 1 or when a + b = 1. The true behavior of Qnihj) 
described in Theorems |3.4| and |3.6| takes the second order terms of i and j into account. In fact 
we have that 

Qn{n ~ cn" , n — cn" ) = — ^ j when a < - . 

For a + b = 1, the asymptotic behavior of Qnian — cn",bn — cn°') varies through several 
regimes as a varies between and 1, and c varies between positive and negative numbers. This 
relationship is illustrated in Figures |4] and [Sj 




b 



Figure 4. Region where Qn{an, bn) ^ Cn/n'^ for some d. 







1 











/ / / / '' 

// / ly / 









71 




Vb = 


1 - 










72 




Vb = 


1 - 


2c 


where 


3 
8 


< a < |} 


73 




Vb = 


1 - 


n 8 








74 




Vb = 


1 + 










75 




h6 = 


1 + 


2c 


where 


1 
2 


< a < 1} 



Figure 5. Region where Qnian, bn) ^ Cn/n'^ for some d. 

In Figure [Sj on the curve 71 , we have 

Qn{an — c^/n, (1 — a)n — c^/n) — Q 



Similarly, on 72, we have 



Qn{an — en", (1 — a)n — erf) = 6 



n2 2q 
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In the space between 73 and 74, we have 

Qn{o.n + k, (1 ~ a)n + k) — 

where —cni < k < cn^ . Finally, on 75, we have 

Qn{an + cn°', (1 — a)n + erf) 



e 



714 



C'n 



e 



As in Theorem |3.3[ the following result strengthens Theoreni |3.4| in a different direction. For 
a, 6, c, a where G(a, h, c, a) < 00, we calculate the value of M{a, b, c, a). 

Theorem 3.6. For a,b, c, a as above, we have M{a,b,c,a) = 



v{a, b) if 1 < a + 6 < 2, 

w(c) z/a = 6= l,0<a<l, 

u{c) if a = 6 = 1, c > 0, a = 0, 

w{c) if a + = 1, c < 0, I < a, 

a;(a, c) if a + 6 = 1, c < 0, a = ^ 



z{a) if a + &=l, 0<a< 

z{a) if a + b 

z{a)+y{a,c) if a + b 

y{a,c) if a + b 

y{a,c) K,{a,c) if a + b 



1, c < 0, I < a < i, 
1, c> 0, a = |, 
1, c> 0, I < a < i, 



1, c > 0, a 



where 

c 

u{c) - 



s=0 



1 



w{c) 



2c + 1 - s 
1 

y(a,c) 



2c + 1 - s 
c+1 



4S-2C-1 



v{a, b) 



20F(2-a-6)3(a + 6- 1)5 



a;(a, c) 



47ra2 (1 - a) 3 Jq (s + 2c) 



exp 



4a(l 



2c^ 



/Traa (1 



a 2 



z(a) 



r(|) 



22 7ra4 (1 — a) 4 



and K(a, c) is defined as in Theorem 3.3 



Observe that for c = or a = 0, values Q„(an — erf , (1 — a)n — erf) behave the same 



asymptotically as Qn{an — erf , {\ — a)n — crf-\-\). We explain this in more detail in Lemma 5.8 



This is in contrast with the behavior of Pn{', ■), where we need to adjust when on the anti- 
diagonal. Note also that fora = &= l,a=:0 and c = 0, we have 

u(0) = - = hm = hm , 

4 n-i-oo C/„ n->oo 0„ 



which holds since (5„(n, n) — C„_i given in the proof of Proposition 2.4 We prove the theorem 
in Section [Sl 



4. 123-AVOIDING PERMUTATIONS 

4.1. Combinatorics of Dyck Paths. We say a Dyck path of length 2n is a path from (0,0) 
to (2n, 0) in consisting of upsteps (1,1) and downsteps (1,-1) such that the path never goes 
below the a;-axis. We denote by I?„ the set of Dyck paths of length 2n. We can express a Dyck 
path 7 € I?„ as a word of length 2n, where u represents an upstep and d represents a downstep. 

Recall that P„(j, k) is the number of permutations a S iS„(123) with (j{j) = k. Let f{n^ k) = 
P„(l,fc) (or P„(fc,l)). Let b{n,k) be the number of lattice paths consisting of upsteps and 
downsteps from (0,0) to (n + k — 2,n — k) which stay above the x-axis. Here b(n,k) are the 
ballot numbers^ given by 

n — k + lfn + k — 1^ 

b{n, k) = 



k-1 

Lemma 4.1. For all 1 < k < n, we have f{n, k) = b{n, k) 
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Proof. We have that f{n, k) counts the number of permutations cr G iS„(123) such that (7(1) = k. 
By the RSK-correspondence (see e.g. |B21IS1| ). we have f{n, k) counts the number of Dyck paths 
7 S I?„ whose final upstep ends at the point {n + k — 1, n + 1 — k) . Remove the last downstep 
from path 7, and all the steps after it. We get a path 7' from (0, 0) to (rt + fc — 2, n — fc) which 
remains above the a;-axis. These paths are counted by b{n,k), and the map 7 — > 7' is clearly 
invertible, so f{n, k) = b{n, fc), as desired. □ 

Lemma 4.2. For all I < j,k < n, we have 

Pnij, k) = bin — k + I, j) b{n — j + 1, fc), where j + k < n + 1. 
Similarly, we have 

Pn{j, k) = b{j, n — fc + 1) b{k, n — j + 1), where j + k > n + 1. 
Proof. Let us show that the second case follows from the first case. For j + A; > n + 1, we have 
P„(j, k) = P„{n + l-j,n + l-k) 

= b{n - [n + 1 - k) + l,n + 1 - j) b{n - {n + 1 - j) + l,n + 1 - k) 
= 6(fc, n — j + 1) 6(j, n — fc + 1), 

by Proposition |2.2| and the first case of the lemma. Therefore, it suffices to prove the lemma 
for j + k < n + 1. 

Let j + k < n + 1, and let c be a 123-avoiding permutation with a{j) — k. We use 
decomposition a = r/cp, where 

T = {ct(1), ...,a{j- 1)} and p = {a{j + 1), . . . ,cr(n)}. 

We now show that a{i) > k, for all 1 < i < j. Suppose o'(i) < k for some i < j. Then there are 
at most (j — 2) numbers x < j with (t(x) > k. Since cr(j) — k, in total there are (n — k) numbers 
y such that a{y) > k. Since j — 2 < n — k, there must be at least one number z > j with 
a{z) > k. However, this gives a 123 pattern consisting of {i,j,z), a contradiction. Therefore, 
a{i) > k, for all 1 < i < j. 

Consider the values of a within r. From above, the values within t are all greater than k. 
Given a possible r, the values within p which are greater than k must be in decreasing order, 
to avoid forming a 123-pattern starting with k. Therefore, to count possible choices for r, it 
suffices to count possible orderings within a of the numbers x with k < x < n. The number of 
such orderings is b{n — k + 1, j), since the smallest number is in the j-th position. Therefore, 
there are b{n ~ k + 1, j) possible choices for t. 

Now consider the values of a within {k} U p. We have {n — j + 1) numbers to order, and 
{k — 1) of them are less than k. Our only restriction on p is that wc have no 123-patterns. 
There are b{n — j + 1, k) of these orderings, since the fc-th smallest number is in the 1-st position. 
Therefore, we have b{n — j + 1, fc) possible choices for p. 

Once we have chosen t and p, this completely determines the permutation a. Therefore, 
there are b{n — j + 1, k)b{n ~ k + 1, j) choices of such a, as desired. □ 

Example 4.3. Let us compute -P7(4, 3), the number of permutations a G 57(123) with ct(4) = 3. 
The numbers 1 and 2 must come after 3 in any such permutation, since otherwise a 123 will 
be created with 3 in the middle. There are 

5(7-3 + l,4) = ^Q=14 
ways to order the numbers between 3 and 7, shown here: 



(47635) (54736) (57436) (57634) (64735) (65437) (65734) 
(67435) (67534) (74635) (75436) (75634) (76435) (76534). 



12 



SAM MINER AND IGOR PAK 



For each of these, there are 

i>(7-4 + 1.3) = H(^ 

ways to place the numbers between 1 and 3, shown here: 

(***31*2) (***32 1*) (***32*1) (***3*12) (***3*21), 

where the asterisks represent the positions of 4,5,6, and 7. In total, we have ^7(4, 3) 
6(5,4)6(4,3) = (14)(5)- 70. 



4.2. Proof of theorems 3.1, 3.2, and 3.3, The proof follows from several lemmas: one 



technical lemma and one lemma for each case from Theorem 13.11 
Let h: [0, 1]^ ^ M be defined as 

(1 - a + 6)(i-"+'')(l - 6 + a)(i-^+'^) 

Lemma 4.4 (Technical lemma). We have 

h{a, b) < 4, for all < a, 6 < 1. 
Moreover, h{a, b) = 4 if and only if b = 1 — a. 

Proof. Observe that h{a, 1 — a) = 4. Furthermore, we consider the partial derivatives of h with 
respect to a and 6. We find that h has local maxima at each point where 6 = 1 — a. In fact 
these are the only critical points within [0, 1]^. We omit the details]^ □ 

Lemma 4.5 (First case). Let a,b E [0, l],c 7^ 0, and < a < 1, such that a + b ^ 1. Then 
F{a, 6, c, a) ~ 00. Moreover, for n sufficiently large, we have Pn{an — cn" , bn — cn°')/C'n < e", 
where e is independent of n and < e < 1 . 



Proof. By lemmas [4 . 1 1 and |4r2| we have 

Pn{an ~ cn^jbn — cn°') ~ b{n — [bn ~ en"") + 1, an — cn") b{n — {an — cn") + l,bn ~ cn") 
(n(l - a - 6) + 2cn" + 2) V n(l-6 + a) \f n(l - a + b) 



n^(l — 6 + a)(l — a + 6) V"- ^ (^'^ ^ cn") + ij \n — (an — cn") + 1 
Applying Stirling's formula gives 

Pn{a.n — cn", hn — cn") ^ r(n, a, b) ■ h{a, 6)", 

where r(n, a, b) = 



(n(l - a - 6) + 2cn" + 2)2(an - cn°'){bn - cn")^(l - a + 6)(1 - 6 + a) 
~ 27rri3(n(l - a) + cn°' + l)(n(l - 6) + cn« + 1)(1 - a + 6)(1 - 6 + a)^a6(l - a)(l - 6) 
Using 

4" 



we obtain 

n'^Pn{an~ cn°',bn~ cn°') ^ i,Nn .-n 

- /ir r{n,a,b) h{a,b) 4: . 



Clearly, for h{a,b) < 4, the r.h.s. — > as n — > 00, for all d e M+. By Lemma 4.4 we have 
h{a, 6) < 4 unless 6 = 1 — a. Therefore, since a + 6 7^ 1, we have F{a, 6, c, a) — 00. Also, when 
n is large enough, 

Pn{an- cn°',bn- cn'^) //i(a,6)+4\" 

a. ^ [ 8 ) ' 

as desired. □ 



The proof follows similar (and even somewhat simplified) steps as the proof of Lemma 5.5 
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Lemma 4.6 (Second case). For all a e (0,1), < c, and ^ < a < 1, we have F{a,l 
a,c,a) = oo. Moreover, for n large enough, we have 

Pn{an — cn°' , {1 — a)n — cn") „2q-i 
where e is independent of n and < e < 1 . 

Proof. Let k = cn°'. Evaluating P„(an — fc, (1 — a)n — fc), we have 

(2fc + 2)2 / 2(1 -a)n \/ 2an 

PJan-kJl-a)n-k) ^ ^— 4 \ ' 

^ ' ' {2{l - a)n)i2an) \{l - a)n + k + ij \an + k + l 

Using Stirling's formula and simplifying this expression gives 



P„(an - fc, (1 - a)n - k) ^ ^ 3 4^, ^, 

7r(a(l - a))2n3 Van + fc 



an+A: 



(1 — a)n 
(1 — a)n + fc 



(1 — a)n+fc 



an 
an ^ k 

(1 — a)n 
(1 — a)n — k 



{l — a)n — k 



Clearly, 



Therefore, 



In 



an + k 



a7i-\-k 



an — k 



an—k 



as n — > oo. 



an 



n'^P„{an-k,{l-a)n-k) n'^{k + l)^ 



exp 



Cn y'^{a{l — a)n)i 

Substituting k <— cn", gives 

n''-Pn{an — k,{l ~ a)n — k) c^n''- 

Cn y'7r(a(l — a))3n2~2a 

For a > |, this expression — > as n — )■ oo, for all d. This implies that F{a, 1 — a, c, a) = oo. In 
fact, we have also proved the second case of Theorem 3.6 as desired. □ 



exp 



a(l — a)n 



a(l - a)ni-2Q 



Lemma 4.7 (Third case). For all a e (0, l),c > 0, and a e [0, 1], we have 

3 

F{a, 1 - a, 0, a) = F{a, 1 - a, c, 0) = - . 
Furthermore, we have L(a, 1 — a, c, 0) — ^(a, c). 

Proof. In this case, to ensure that crt" measures the distance from the anti-diagonal, we need 
to analyze P„(an — cn" , (1 — a)n — cn" + 1). Evaluating as in Lemma 4.6 gives 

n'^PJan-cn",(l-a)n-cn°' + 1) n'^-^2k + l)'^ \ -fc^ 

Cn 40r(a(l-a))5 [a{l - a)n 

For c = 0, we get F{a, 1 — a, 0, a) = 3/2 and L{a, 1 — a, 0, a) = ^(o, 0). For a = 0, we get 
F{a, 1 — a, c, 0) = 3/2 and L{a, 1 — a, c, 0) — ^(a, c), as desired. □ 

Lemma 4.8 (Fourth case). For all a E (0, 1), c > and < a < i, we have 

3 

F{a, 1 — a, c, a) ~ - — 2a. 
Furthermore, for < a < ^, we have 

L{a,l ~ a,c,a) = ri{a,c) and L (a. l — a, c, -j = 77(0, c)k(o, c), 



where r]{a,c) and K{a,c) are defined as in Theorem 3.3 
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Proof. As in Lemma |4.6[ we have 

'nf^Pn{an — fc, (1 — a)n — k) 

We can rewrite this expression as 



A/7r(a(l — a))2n2 
For a < 5, we clearly have 



exp 



exp 



a(l — a)n 



7r(a(l — a)) ^" 

77(0, c) n'^-d-^a) 



a(l - a)ni-2a 



l~2a 



exp 



a(l - a)7ii-2« 



1 as n — > 00, 



a(l - a)ni-2a 

so F(a^ 1 — a, c, a) = | — 2q; and i(a, 1 — a, c, a) = ri{a,c). For a = ^, by the definition of 
K{a, c), we have 



exp 



K(a, c), as n — >■ cxd, 



_a(l - a)ni-2a^ 

so i^(a, 1 — a, c, 1/2) = 1/2, and _L(a, 1 — a, c, 1/2) = 77(0, c)K(a, c), as desired. 



□ 



Let us emphasize that the results of the previous two lemmas hold for c < as well as c > 0. 
This is true by the symmetry of Pn{j, k) displayed in Lemma 2.2 and since c only appears in 
the formulas for rj^a^c) and K{a,c) as c^. Therefore, we have proven all cases of theorems 
and 13^ 



3.1 



5. 132-AVOIDING PERMUTATIONS 

5.1. Combinatorics of Dyck paths. We recall a bijection ip between 5„(132) and Dn, which 
we then use to derive the exact formulas for Qn{j, k). This bijection is equivalent to that in |EPj . 
itself a variation on a bijection in jKra) (see also [B21 IKit] for other bijections between these 
combinatorial classes). 

Given 7 e I?„, for each downstep starting at point {x,y) record y, the level of {x,y). This 
defines y^ = {yi,y2, ■ ■ ■,yn)- 

We create the 132-avoiding permutation by starting with a string {n, n — 1, . . . , 2, 1} and 
removing elements from the string one at a time each from the y^-th spot in the string, creating 
a permutation Suppose this permutation contains a 132-pattern, consisting of elements 

a, 5, and c with a < b < c. After a has been removed from the string, the level in the string must 
be beyond b and c. Since we can only decrease levels one at a time, we must remove b before 
removing c, a contradiction. Therefore, the map ip is well-defined, and clearly one-to-one. By 
Theorem |2.1[ this proves that ip is the desired bijection. 

Example 5.1. Take the Dyck path 7 = {uuduuddudd) . Then z-y = (2,3,2,2,1), as seen in 
Figure |6] We then create our 132-avoiding permutation (^(7) by taking the string {5, 4, 3, 2, 1} 
and removing elements one at a time. First we remove the 2-nd element (4), then we remove the 
3-rd element from the remaining list {5, 3, 2, 1}, which is 2, then the 2-nd from the remaining 
list {5, 3, 1}, which is 3, then the 2-nd from {5, 1}, which is 1, then the last element (5), and 
we obtain (^(7) = (4, 2, 3, 1, 5). 

Level 3 
Level 2 
Level 1 




Figure 6. Dyck Path 7 with downsteps at y^ = (2, 3, 2, 2, 1). 
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Let g{n, k) be the number of permutations a G iS„(132) with (7(1) = k, so g{n, k) — (5„(1, k). 
RecaU that since Qnij, k) — Qn{k,j), we can also think of g(n, k) as the number of permutations 



a g 5r, (132) with cr(fc) ~ 1. Let b{n, k) denote the ballot numbers as in Lemma 4.1 
Lemma 5.2. For all 1 < k < n, we have g{n, k) — b{n, k). 

Proof. Let a £ 5,i(132) with cr(l) — k. Using bijection (p, we find that (p^^{a) is a Dyck path 
with its final upstep from (n + k — 2,n — k) to (n + fc — 1, n + 1 — fc). The result now follows 



from the same logic as in the proof of Lemma |4.1[ □ 

Lemma 5.3. For all I < j, k < n, 

Qn{j,k) = ^ 6(n- j + l,fc-r) b(n - k + 1, j - r) Cr, 

r 

where the summation is over values of r such that 

max {0, j + k — n — l}<r< min {j, fc} — 1. 

Proof. Since our formula is symmetric in j and k except for the upper limit of summation, 
proving the lemma when j < k will suffice. When j < k the upper limit is j — 1, rather than 
fc — 1 when j > fc. Qnij, k) represents the number of permutations a G 5„(132) with a{j) = fc. 
Let qnij,k,r) be the number of 132-avoiding permutations a counted by Qn{jik) such that 
there are exactly r values x with x < j such that cr(a;) < fc. Below we show that 

q(n,j, fc, r) = b{n — j + l,k — r) b{n — fc + 1, j — r) Cr for all < r < j — 1, 

which implies the result. 

Let cr e 5„(132) such that a'{j) = fc and there are exactly r numbers Xi with Xi < j and 
a'{xi) < — fc. We use decomposition a = TTrkcj), where 

T = {o-(l): ■ ■ • ,cr(j - r - 1)}, TT = {(T{j - r), . . . , cr(j - 1)}, and (j) = + 1), . . . ,cr(n)}. 

Observe that either all elements of tt are smaller than fc, or there is some element of tt greater 
than fc, and some element of r smaller than fc. Suppose the second case is true, with a an 
element of r smaller than fc, and b an element of tt larger than fc. Then a, b, and fc form a 
132-pattern, a contradiction. Therefore, all elements of tt must be smaller than fc. 

Suppose some element a: of tt is smaller than (fc — r). Then some number y with k — r<y<k 
is an element of (j). Then we have a 132-pattern, formed by x, fc, and y, which is a contradiction, 
so TT consists of {fc — r, fc — r + 1, . . . , fc — 2, fc — 1}. There are Cr possible choices for tt, since tt 
must avoid the 132-pattern. 

Now consider the values of a within r. Observe that regardless of t, the numbers s in </> 
with s > k must be in decreasing order in </), in order to avoid a 132-pattern that starts with fc. 
Therefore, the number of possible choices for r is equal to the number of possible orderings of 
the numbers between fc and n that avoid 132, with fc in the (j — r)-th position (since tt only 
consists of numbers smaller than fc). There are exactly b{n — k + 1, j — r) such possible choices. 

Finally, consider values of a within {fc} U (j). Here we need to order n — j + 1 numbers so 
that they avoid the 132-pattern, with the first number being the (fc — r)-th smallest. There 
are exactly b{n — j + 1, k — r) ways to do this. Choosing tt, r, and (j) completely determines a. 
Therefore, there are b(n — j + 1, fc — r) b{n — k + 1, j — r) Cr possible choices for cr, as desired. □ 

Example 5.4. Let us compute (5/(4, 3), the number of permutations cr S 5„(132) with cr(4) = 
3. We count the permutations separately depending on how many numbers smaller than 3 
come ahead of 3. First suppose r = 0, so there are no numbers smaller than 3 ahead of 3 in 
the permutation. This means that 3 is in the 4-th position among those numbers greater than 
equal to 3. There are 

-o,.^(--').?(^).» 
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ways to order the numbers between 3 and 7, displayed here: 

(45637) (54637) (56437) (56734) (64537) (65437) (65734) 
(67435) (67534) (74536) (75436) (75634) (76435) (76534). 

For each of these there are 

6(7-4+l,3-0) = ?Q)=5 

ways to place the numbers between 1 and 3, shown here: 

(***312*) (***321*) (***32 * 1) (* * * 3 * 1 2) (***3 * 21), 

where the stars represent the positions of 4,5,6 and 7. In total we find that 97(4,3, 0) = 
6(5,4)6(4,3) = (14)(5) = 70. 

Similarly, for r = 1 there is 1 number smaller than 3 ahead of 3 in the permutation. This 
number has to be 2, since otherwise a 132 pattern would be formed with 1,2, and 3. Also 
this number must be directly in front of 3 in the permutation, since otherwise a 132 would be 
formed with 2 as the 1 and 3 as the 2. This means that 3 is now in the 3-rd position among 
those numbers greater than equal to 3. There are 

6(7-3 + l,4-l) = ^Q=9 

ways to order the numbers between 3 and 7, displayed here: 

(45367) (54367) (56347) (64357) (65347) (67345) (74356) (75346) (76345). 
For each of those orderings there are 

6(7-4 + l,3-l)Ci = ^Q =3 

ways to place the numbers between 1 and 3, displayed here: 

(** 231 **) (** 23 * 1*) (** 23**1). 

Therefore, overall we have (77(4, 3, 1) = 6(5, 3)6(4, 2)Ci = (9)(3) — 27. In other words, there are 
27 distinct 132-avoiding permutations of length 7 with 3 in the 4-th position, and one number 
smaller than 3 and ahead of 3. 

The final case is when r = 2, in which case both 1 and 2 come ahead of 3 in the permutation. 
This means that 3 is in the 2-nd position among those numbers between 3 and 7. Therefore 
there are 

.(7-3+1,4-2). 1(«). 4 

ways to order the numbers between 3 and 7, displayed here: 

(43567) (53467) (63457) (73456). 

For each of these we have 

6(7-4+l,3-2)C2= Q(2) = 2 

ways to place the numbers between 1 and 3, displayed here: 

(*123***) (*213***). 

Together we have that 177(4,3,2) = 6(5, 2)6(4, 1)6*2 = (4)(1)(2) = 8, so there are 8 different 
132-avoiding permutations of length 7 with 3 in the 4-th position, and two numbers smaller 
than 3 and ahead of 3. We have shown that 

QriA, 3) = 97(4, 3, 0) + 97(4, 3, 1) + 97(4, 3, 2) = 70 + 27 + 8 = 105. 



SHAPE OF PATTERN AVOIDING PERMUTATIONS 



17 



5.2. Proof of theorems |3.4[ |3.5[ and |3.6[ The proof again involves one technical lemma 
and several cases corresponding to the statements of theorems |3.4| and |3.6| 
Let h: [0, 1]^ ^ M be defined so that 

_ 4°**(1 -at + a- asty-''*+''''"'\l ~ a + at ~ ast)i-"*+"-""* 

- (1 - at)(i-"*)(a - a.st)(''-'''**)(l - a)(i-'^)(ai - asi)('^*-°''*) 

Lemma 5.5. For all (a,s,t) e [0,1]'^, we have h{a,s,t) < 4. Moreover, 

h{a, s,t) = 4 if and only if s ^ — . 

at 

Proof. Take the logarithmic derivative of h to obtain 

^^^^^ = at In 4+ {-at{l + ln(l - ai + a - ast))) + (-at(l + ln(l - a + at - ast))) 
as 

- [~at{l + In (a - ast)) - at(l + In {at - ast))] 

= ai In [4(a — ast)[at — ast)] — atln [{1 — at + a — ast){l — a + at — ast)]. 
Set this derivative equal to to get 

4(a — ast){at — ast) — {1 — at + a — ast){l — a + at — ast) — 0, 



or 



givmg 



Since 



{ast - {at + a- 1)) {3ast - {at + a + 1)) = 0, 



at + a — 1 
at 



at + a + 1 
Sat 

1 1 1 



at + a+1 _ 1 1 1^. _ ^ _ ^ 
Sat 3 3i Sat ~ 3 3 3 ' 

this value of s is greater than 1, and is only equal tolifa = s = i = l. Similarly, the ratio 
{at + a — l)/at is between and 1 if at + a > 1. It is easy to see that the second derivative 

(P{lnh) at + a-1 

which implies that this value of s does indeed maximize h{a, s, t). We can also verify that 



t^a, 



at + a — 1 
at 



4(at+a-i)(2 _ 2at)(2-2at)(2 - 2a)(2-2'^) 
(1 - at)(i-"*)(l - at)(i-'^*)(l - a)(i-°)(l - a)(i-«) 



Observe that h{a, s,t) < 4 on the boundary of [0, 1]^ except for where a = s = t = 1, completing 
the proof. □ 

Lemma 5.6. Let a,b E [0, 1]^, c 7^ and < a < 1, such that a+b < 1. Then G{a, 6, c, a) = 00. 
Moreover, for n sufficiently large, we have 

Qn{an — cn°', bn — cn") 

where e is independent of n, and < e < 1. 
Proof. By Lemma |5.3[ we have 

Qn{atn, an) = b{n — atn + 1, an — r) b{n — an + 1, atn — r) C'r 



< e" 



E 



n — atn + 1 — {an — r) + 1 /n — atn + an — r 
n — atn + 1 + {an — r) — 1 \ n — atn + 1 

n — an + 1 — atn + r + l/n — a7i + l + atn — r — 1 
n — an + 1 + atn — r — 1\ n — an + 1 
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1 /2r^ 



r + 1 \ r 

where the summation is over values of r such that 

max {0, j + k — n — 1} < r < min {j, fc} — 1 . 

Let r = atsn, so s varies from to (l — by increments of Applying Stirling's formula, 
we get 

Qn{atn, an) ^ ''^^ x{n,atn,an,astn) h{a,s,t)"', 

r 

where 

{\ — at + a — ats){l — a + at — ats) 



x{n, atn, an, astn) 



j (1 — at){a — ats){l — a){at — ats){ats) 
a'^t{l - s)(l - st)(n(l -a-at + ats) + if 



2{7Tn)^/^{n{l - at) + l)(n(l - a) + 1)(1 + a - at - ats)(l - a + at - ats){atsn + 1) 
We now have 

n'^Qnian — cn" ,bn — en") ^ ^+1 v-^ , x 
^Jim +2 2^ Vr{n), 

where 

Vr(n) — x{n, an — cn°', bn — cn" , r) h{b, r/an, a/b)^ 4^". 



From Lemma 5.5 we have that h{b, r/an, a/b) < 4 for r (a + b — l)n. For values of r where 
h(b,r/an,a/b) < 4, v^i''^) decreases exponentially as n — oo for fixed d. Therefore, for these 
values of r, 

^ixn'^^'^Vrin) — as n — > 00 for all d. 
The only values of r which could potentially have lim„_yoo Vrin) 7^ 0, are when r ^ (a + 6— 
as n — > cx). Observe that since a + & — 1 < 0, there are no such possible values of r. Li this case, 

hm ^'Q^Mn-cn^M-cn-) 

This implies G(a, b, c,a) — 00 when a + b < 1. Also, for n large enough, we have 
Qn(an ^ en" ,bn ^ cn") ^ f 1 + h{b,0,a/b) 



as desired. □ 

Lemma 5.7. Let a E [0, 1], c > 0, and ^ < a < 1. Then G{a, 1 — a,c,a) — 00. Moreover, for 
n large enough, we have 

Qn{an — cn", (1 — a)n — cn") „2q-i 

where e = e{a, c, a) is independent of n, and < e < 1. 
Proof. Let k — cn". Then 

Qnian - fc, (1 - a)n - fc) = Qnian - fc, (1 - a)n - fc, 0) Sa,n,k , 

where 

Sa,n,k = ( 1 + X! ^'■(^ 

and 

gr{n) 



an—k— 1 

in) 



qn{an — fc, (1 — a)n — fc, r) 
qn{an — fc, (1 — a)n — fc, 0) 
Observe that 

Qnian — fc, (1 — a)n — fc, 0) = P„(an — fc, (1 — a)n — fc). 
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Applying Stirling's formula and using the Taylor expansion for ln(l + x) gives 

-(4fcr + r^)" 



, , {2k + r + 2fC, 

-i^) ^o;, , o\9^^ exp 



(2fc + 2)24 



4a(l — a)ri 



Therefore, 



n'^Qnio-n — cn" , bn — en") / n'^Pn{an — cn" , bn — en") 



an—k—l 



1+ E 



{2k + r + 2)^Cr 
{2k + 2)2^ 



exp 



4a(l — a)n 



For a > H, by Theorem 



3.1 



we have 



n'^ P„{an - cn" , {I - a)n - cn") 
lim — = for all a. 

Therefore, G{a, 1 — a, c, a) = cx) for a > |. Also, we have proven the second case of Theorem 
as desired. 



3.5 



For the next three cases, we denote r = hn'P, and let h and p be fixed as n — )■ cxo. For p > 5, 
we have 

n'^grin) 



as n — >■ 00, for all d, 



since gr{n) decreases exponentially for fixed d. 
For a < p < 5 , we have 



r2 / \/h 



n2 



-2q 



For p<ck<i orp<Q;=|,we have 



5r = B r 



Similarly, for p = ^, we obtain 



Lemma 5.8. Let a E [0, l],c e M and < a < |. Then 



gr = Q{n-i 



G{a, 1 — a, c, a) = - and M{a, 1 — a, c, a) = z{a), 



where 



z{a) 



r(i) 



as in Theorem\3. 



2i7r[a(l-a)]J 
Proof. As in Lemma |5.7[ we write 

Qn{an — CTi", (1 — a)n — cn") — Pn{an — cn" , (1 — a)n — cn") Sa.n,k , 

where 



an—k—l 



Sa,n,k = ^+ ^ gr{n). 



r=0 



Again, as n — > cx), we have 



, , (2fc + r + 2)2a 
9r{n) - (2fc + 2),4. exp 

Fix s > 0, and observe that for any < a < |, we have 



-{Akr + r^) 
4a(l — a)n 



g„5(n) = o(5^y^(n)), for every (5 7^ -. 
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Therefore, as n oo, t — )■ 0, and u — )■ oo, we have 

Sa,n,k ~ ^ 9rin). 
r—t^/n 

Interpreting this sum as a Riemann sum, we have 



^ r (2fc + Vn + 2)2 
v/n / — I exp 



Sa,n,k 



4a(l — a)n 



dv. 



Therefore, we have 

A direct calculation gives 



1 1 

■y 2 ri4 

I -TTTi — ^ I exp 



4a(l - a) 



dv. 



Sa,n,k = '^^^ — z{a) ( Vtt [a(l - a)] • 



Now we see that 

n'^Qn{an — en", (1 — a)n — cn'^) n'^Pn{an — cn", (1 — a)n — en") 



Sa.'i 



by the proof of Theorem 



3.1 



and the analysis of Sa.n,k- Therefore, G{a, 1 — a,c, a) = |. For 



a < I this also gives M(a, 1 — a, c, a) = z{a), as desired. 



□ 



This case displays why we do not need to adjust the our analysis to be on the anti-diagonal. 
Since the behavior of Q depends on values of r on the order of y/n, adding 1 to the second 
coordinate is a lower-order term and does not affect G or M at all. In fact, the whole value of 
cn" has no effect on G or M for this case. 



Lemma 5.9. Let a E [0, 1], c > 0, and 1 < a < 



G{a, 1 — a, c, a) 



Then 
3 



2a. 



Moreover, 



M{a, 1 — a,c, a) 



y{a,e) 

y{a,e)K{a,c) 



I <a< i 



if a=\. 



where y{a,e) and K{a,e) are defined as in Theorem 3.3 



Proof. As in the previous lemma, we have Qn{an — cn", (1 — a)n — cn") = P„(an — cn", (1 — 
a)n — cn") Sa,n,k- We analyze Sa,n,k to see which values of r contribute the most. In this case, 
for p — ^, we have gr — Q{ni^'^"), which is on the order of n"^ with d strictly less than — i. 
Therefore, even if we sum over all values of r where p = |, we will end up with an expression 
on the order of n'^'^i which is lower order than a constant. For p < a < | orp<a = since 

gr — Q{n^^), the terms with the highest order will come when p — 0. Therefore, the values of 
r which contribute the most to Sa.n k will be constants in this case. From this, we have 



r=l 



1 



E 



2, as n 



Therefore, 



n'^Qn{an — k,{l — a)n — k) 2n'^Pn{an — k, {1 — a)n — k) 



Cn 
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Referring back to Theorems |3.1| and |3.3| gives us the desired results. 



□ 



Lemma 5.10. Let a G [0, 1] and c > 0. Then G{a, 1 — a, c, 3/8) — | and M{a, 1 — a, c, 3/8) = 
z{a) + y{a,c). 

Proof. Here we are essentially on the intersection of the last two cases, which provides some 
intuition to the reason that M{a, 1 — a,c, 3/8) = z{a) + y{a, c). Again we let r — hn^. When 
a = |, values of gr which contribute the highest order to Sa,n.k are when p — Q and when 
p = i . We get z{a) from the terms where p = \ , and j/(a, c) when p = 0. 

z{a) 



so 



n'^Qnian — fc, (1 — a)n — k) 



/7f[a(l-a)]^ ) +2, 
2c2 



-n f 



Cn y^{a{l — a)) 

so G{a, 1 — a, c, a) = I and M{a, 1 — a, c, a) = z{a) + y{a, c), as desired. 

Lemma 5.11. Let c > and < a < 1. Then 



□ 



G{1, l,c,a) = -a. 

Moreover, for a > 0, we have M(l,l,c, a) = w{c), and Af(l.l,c, 0) = u{c), where w{c) and 
u{c) are defined as in Theorem 



Proof. We first consider (5„(n — k,n — k) with k — cn°', and a > 0. We have 



i{n^k,n~k)= b{k + l,n — k — i)'^Ci 



which is equivalent to 



Qn{n - k,n- k) ^ CkCkCn-2k-i 1 + X! ^rin) , 



r=l 



where 



hr{n) 



Observe that hr{n) r^ exp , so hi^s{n) — o{h i [n)) for all 5 ^ ^. From here we have 



n'^Qn{n — k,n ~ k) n'^ 



47rfc3 7q 



77," 2" 



/•oo 




/ exp 


2c 


'o 



^ re 2 

s exp 



2c 



Therefore G(l, 1, c, a) = |a and 



M(l,l,c,a) = 5 = w(c), 

22 7r2 c2 



as desired. 
For a = 0, 



n — c— 1 



Qn{n ^ k,n — k) = Qn{n ~ c,n — c) = 6(c + 1, n — c — i)^Ci, 

i— n- 

s + 1 /2c + 1 - 



E 

s=0 



2c+l-sV c+1 



i— 2c— 1 
2 

Cri-2c-l+s- 
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Therefore, we have 

Qnin — k,n — k) 

completing the proof. 



42 



1 " 



s + 1 /2c + 1 - s 



2c+l-sV c+1 



4^* as n — )• 00, 



□ 



Lemma 5.12. Let a G [0, 1], c < and < a < 1. Then 

''2 j/0<a<i 



G(a, 1 — a, c, a) 



4 "J " " ^ 2 
fa i/ i < a < 1 , 



and 



z{a) if Q < a < \ 
M{a, 1 — a,c,a) — ^ x{a, c) if a — \ , 

^w{c) if ^ < a < 1 



where z{a),x(a,c), and w{c) are defined as in Theorem 3.6 



Proof. We now analyze Qn{an + k, {1 — a)n + k), where k = cn" . We have 



Qn{cin + k, {l — a)n + k) = b{(l — a)n — k + l, {l — a)n + k — r) b{an — k + l,an + k^r) Cr ■ 

r=2fe-l 

We can rewrite this as 

an — k 

Qn{an+k, an+k) — b{{l~a)n—k+l,{l—a)n—k—d+l) b{an—k+l,an—k—d+l)Cd+2k-i- 

d=0 

Denote by the d-th term of this summation. Then we can express Q„(an + k,an + k) as 

/ an—k \ 

Qnian + k, an + k) ^ go i 1 + — ) . 



d=i 



Denote as = ^ . We can express /i^ as 



M-l- '[\2(2(an-k)~d\(2({l-a)n-k)-d\ 
\"-^^) \ an-k A (l-a)n-k ) /C, 



(1- 

f2{an-k)\ f2({l-a)n-k)\ 
V an—k J V (1 — a)n— / 



•'d+2fc-l 
C2fe-1 



We now have 



hd ~ exp 



4an 



exp 



-d2 



4(1 - a)n 



+2k-l 



WC2k-l 



Fix s > and < /3 < 1 . We set d = sn^ , and consider the behavior of hd as n ^ cx) . Observe 
that for any a, 

h,-,5 = o(h 1 ) 

" ^ sn2 ' 

when S ^ ^. For ^ = /3 < a, we have 

£.2 



hd ^ d exp 



4a(l - a) 



For ^ — /3 — a, we have 



Similarly, for a < f3 — ^. 



d^ exp 



— s 
4a(l - a) 



2c 
s + 2c 



hd ^ d^ {2k) 2 exp 



4a(l - a) 
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Therefore, as n ^ oo, t — 0, and u — > oo, 

{an + k,an + fc) - 50 1 + J2 ^'i 

Recall that 

50 



d=tn2 



(27ra(l — a)k) 2 

We are now ready to analyze G{a, 1 — a,c, a). For a < ^ we have 
n'^Qnian + cn°',{l — a)n + cn°') n'^ 



47r(2a(l - a)c)5ni(i+") Jo 
i^-i /r(f)(4a(l-a))t' 



(2/0)252 exp 



4a(l - a) 



ds 



47r(a(l - a))i 



so G(a, 1 — a, c, a) = I and M (a, 1 — a, c, a) = 2:(a), as desired. For a > i we have 



n'^QniO'n + cn" , (1 — a)n + cn") 



47r(2a(l - a)c)ini(i+") Jo 
-5" /7r5(4a(l -a))i\ 



n 2 s exp 



4a(l - a) 



ds 



47r(2a(l -a)c): 



so G(a, 1 — a, c, a) ~ |a and M(a, 1 — a, c, a) = w{c). For a = i we have 



n'^Qn{o-n + cn°', (1 — a)n + cn") 



2 

00 



47r(2a(l - a)c) 5n5(i+") Jo 
.2 r _.,2 



n 2 s exp 



exp 



4a(l - a) 



Aa{l-a) 
ds ^ n''~3a;(a, c), 



2c 



s + 2c 



ds 



47r(a(l - a)) 2 Jo (s + 2c) 2 
proving that G{a, 1 — a, c, ^) = | and M{a, 1 — a, c, ^) ~ x{a, c). This completes the proof. □ 
Our final case is where 1 < a + 6 < 2. 

Lemma 5.13. Let a,b ^ [0, 1], such that 1 < a + b < 2, and Zet c G M, < a < 1. Then 

3 

G{a,b,c,a) — - and M{a,b, c, a) = v{a^b), 



where v{a,b) is defined as in Theorem 3.6 

Proof. Let k — cn°' . We analyze Qn{an + en", bn + cn") in the same manner as the proof of 
Lemma 5.12 by looking at Qn{an + fc, bn + k). We obtain: 

Qn{ail + k,bn + k)^C(^l_a)n+kC(l-b)n+kC(a+b-l)n-2k-l\^+ ^ 9d 



d=l 



where 



We find that 



(d + 1 \2 (2iil-a)n+k)-d\ (2({l-b)n+k)~d\ 
{U^l) y (i^a)n+k A (l~b)n+k I l^i 



/2{(l~a)n+k)\ /2((l-6)n+fc)\ 
V (l-a)ri+fe A (l-b)n+fe / 



^{a+b-l)n-l+d 



{a+b-l) n— 1 



gd ^ d exp 



-d^{2-a-b) 
4(l-a)(l-6)n 



so (7„/3 = 0(5 1 ) if /3 7^ Therefore, 
n'^Qn{an + en" , 6n + cn" ) 



^d-3 



Gn 



47r((l-a)(l-6)(a + 6-l))i 



n 2 s exp 



-s^{2-a-b) 



4(l-a)(l-6) 
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We can now see that G{a,b,c,a) = | and M{a,b,c,a) = v{a,b), as desired. We have now 
proved all cases of Theorems |3.4| and |3.6[ □ 



6. Expectation of basic permutation statistics 

6.1. Results. The following result describes the behavior of the first and last elements of a 
and r. 

Theorem 6.1. Let a G 5„(123) and t G iS„(132) be permutations chosen uniformly at random 
from the corresponding sets. Then 

(1) E[cr(l)] = E[cr"i(l)] = E[r(l)] = E[r-^(1)] ^ n- 2 asn^oo, 

(2) E[cr(n)] = E[cr"^(n)] ^ 3, as n oo, 
and 

(3) E[r(n)] = E[T-i(n)] ^ i!i±ll for all n. 
Before proving the theorem, we need some notation and definitions. 

6.2. Definitions. Let A, B be two finite sets. We say A and B are equinumerous if |^| — \B\. 
Let a : A and (3 : B Z. We say a and /3 are statistics on A and B, respectively. We 
say that two statistics a and j3 on equinumerous sets are equidistributed if |a~^(fc)| = 

for all fc e Z; in this case we write a /3. Note that being equidistributed is an equivalence 
relation. 

For example, let A = iS„(132), let a : A ^ Z, such that a{a) — cr(l), and let /3 : A — >■ Z such 



that f3{a) = <t^^(1). Then a ^ f3, hy Proposition 2.2 Given tt e let 

rmax(7r) = ^{i s.t. 7r(i) > 7r(j) for all j > i, where 1 < i < n.}. 
We call rmax(7r) the number of right-to-left maxima in tt. Let 

ldr(7r) = max{i s.t. 7r(l) > n{2) > . . . > 7r(i)}. 
We call ldr(7r) the leftmost decreasing run of tt. 



6.3. Position of first and last elements. To prove Theorem 6.1 we first need two proposi- 
tions relating statistics on different sets. Let Tn be the set of rooted plane trees on n vertices. 
For all T £ Tn, denote by 6r{T) the degree of the root vertex in T. Recall that I?„ is the set 
of Dyck paths of length 2n. For all 7 G 2?„, denote by 0(7) the number of points on the line 
y = a; in 7. Recall that 

p„| = |5„(123)| = |5„(132)| =C„. 
Recall that |7^+i| = C„ (see e.g. [B21IST]). so {7^,I?„,iS„(123),5„(132)} are all equinumerous. 

Proposition 6.2. Define the following statistics: 

S71 ■ Tn+i — > Z such that 5n{T) = Sr{T), 

Un : "Dn — >■ Z such that ctni^) ~ ct(7)j 

rmax„ : 5„(132) — )• Z such that rmax„(CT) = rmax(cr), 

ldr„ : iS„(123) — > Z such that ldr„((T) ldr((T), 

Idr^j : iS„(132) — > Z such that Idr^(iT) = ldr{a), and 

first„ : 5„(123) — > Z such that first„((T) = (t(1). 



Then, we have 



(Jn ~ ~ rmax„ ~ ldr„ ~ Idr^ ~ (n + 1 — first„) for all n. 
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Proof of Proposition \6.^ Throughout the proof we refer to specific bijections described and 
analyzed in [CK]; more details and explanation of equidistribution are available there. We now 
prove equidistribution of the statistics one at a time. 

• (5„ ~ a„ Recall the standard bijection (/) : Tn+i T^n - Observe that </) : (5„ — >■ a„. Therefore, 
5n Oin, as desired. 



• a„ ~ rmax„ Let V' '■ T^n — > '5„(132) be the bijection presented in Section 5.1 Observe 
that ijj : an ^ rmax„. Therefore, a„ ~ rmax„, as desired. 

• rmax„ ~ ldr„ Let $ be the West bijection between 5„(132) and iS„(123). Observe that 
$ : rmax„ — )> ldr„. Therefore, rmax„ ~ ldr„, as desired. 

• ldr„ ~ Idr'j Let ^E" be the Knuth-Richards bijection between iS„(123) and 5„(132). Observe 
that if ^'(o-) — T for some a € 5„(123), then ldr„(cr) = ldr^(r~^). Since 5„(132) is closed under 
inverses, we get ldr„(5„(123)) ^ ldr^j(5„(132)), as desired. 

• Idi'n ^ (n + 1 — first„) Let A be the Knuth-Rotem bijection between 5„(132) and 5„(321), 
and let r : 5„(321) 5„(123) such that r(CT) = {a{n), . . . ,cr(l)). Observe that if Fo A (cr-i) = r 
for some a £ iS„(132), then \dr[^{a^^) = n + 1 — first„(T). Since ranges over all 5„(132), 
we get Idr^ ^ first„, as desired. □ 

The second proposition explains the behavior of r(n), for r G 5„(132). 

Proposition 6.3. Let t e 5„(132) he chosen uniformly at random. Let last„ : 5„(132) — >■ Z 
he defined as last„(T) = Tin). Then we have 

last„ ~ n + 1 — last„ . 



Proof. By applying Lemma |5.3| for k = n, we obtain 

Qn{j,n) = Cj-iCn-j, 

implying that 

Qn{j, n) = Qn{n + 1 — j, n) for all integers j and n where j < n. 

Since 

\last~^{j)\ = Qn{j,n) and |(n + 1 - last„)~^(j)| = (5„(ri, + 1 - j, n) for aU I < j < n, 
we have last„ ^ (n + 1 — last„), by the definition of equidistribution. □ 



6.4. Proof of Theorem 6.1, Let a G 5„(123) and t e 5„(132) be chosen uniformly at 
random. It is known that 

E\S„] — 3 as n — )■ oo. 



where 5„ is defined as in Proposition 6.2 (see e.g. [FSi Example IIL8]). Since (5„ and (n + 1 
first,! ) are equidistributed by Proposition |6.2[ we have 

E[5„] =n + l-E[a(l)]. 

Therefore, we have E[ct(1)] — ?> (n — 2) as n oo, as desired. 



Due to the symmetries explained in the proof of Proposition 2.2 we have 
E[(7-^(l)] = E[(t(1)] n- 2 and E[cr(n)] = E[cr"i(n)] = n + 1 - E[cr(l)] ^ 3 as n ^ oo, 
completing the proof of ([T]). 



Since i-'n(l, k) — bin, k) — (3n(l, k) for all n and k by lemmas 4.1 and 5.2 we have 



E[r(l)] = E[ct(1)] ^ n - 2 as n ^ oo. 
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Also, by Proposition |2.2[ we have 

E[t"^(1)] = E[t(1)] ^ n- 2 as n^oo, 

completing the proof of 

To complete the proof of Theorem 6.1 we need to prove (|3]). By Proposition 6.3 we have 
last„ ^ {n + 1 — last„), so 

E[last„] = E[n + 1 - last„]. 
By the linearity of expectation, we have E[last„] = (n + l)/2, so 

E[r(n)] = -—, 



as desired. By the symmetry in Proposition |2.2[ we have 

E[r-\n)]^E[r{n)] = ^, 



completing the proof. 



7. Fixed points in random permutations 

7.1. Results. Let a € Sn- The number of fixed points of a is defined as 

fp„(CT) = #{i s.t. cr(i) = i,l <i<n}. 

In [El', §5.6], Elizalde uses bijections and generating functions to obtain results on the expected 
number of fixed points of permutations in iS„(321), 5„(132), and 5„(123). In the following three 
theorems, the first part is due to Elizalde, while the second parts are new results. 

We use In,e{o) — [(a ~ (a + to denote the intervals of elements in {1, . . . , n}. 

Theorem 7.1. Let e > 0, and let a G 5„(321) he chosen uniformly at random. Then 

E[fp„((T)] = 1 for all n. 

Moreover, for a G (e, 1 — e), 

P (cr(i) = i for some i G In.e{a)) ^0 as n ^ oo. 
Theorem 7.2. Let e > 0, and let a G 5„(132) be chosen uniformly at random. Then 

E[fp„(cr)] = 1, as n ^ oo. 
Moreover, for a G (0, 1/2 - e) U (1/2 + e,l-e), 

P (cr(i) = i for some i G /„,e(a)) — > as n ^ oo. 
Theorem 7.3. Let £ > 0, and let a G 5„(123) be chosen uniformly at random. Then 

E[fp„(o-)] ^ ^, as n -H- oo. 

Moreover, for a G (0, 1/2 - e) U (1/2 + e, 1), 

P ((T(i) — i for some i G /„,e(a)) — as n ^ oo. 

In fact, Elizalde obtains exact formulas for E[fp„((T)] in the last case as well [Ell Prop. 5.3]. 
We use an asymptotic approach to give independent proofs of all three theorems. 

The final case to consider, of fixed points in 231-avoiding permutations, is more involved. 
In the language of Section [TJ the expectation is equal to the sum of entries of Q„ along anti- 
diagonal A, parallel to the wall. It is larger than in the case of the canoe since the decay from 
the wall towards A is not as sharp as in the case of the canoe. 

In [El I , Elizalde calculated the (algebraic) generating function for the expected number of 
fixed points in 5„(231), but only concluded that E[fp„(CT)] > 1 for n > 3. Our methods allow 
us to calculate the asymptotic behavior of this expectation, but not the location of fixed points. 
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Theorem 7.4. Let e > 0, and let a e iS„(231) he chosen uniformly at random. Then 

E[fp„(o')] ^ — ^J— nJ, as n — > oo. 

Recall that it a £ Sn is chosen uniformly at random, then E[fp„(cr)] = 1, so the number 
of fixed points statistic does not distinguish between random permutation in 5„(132), 5„(321) 
and random permutations in Sn- On the other hand, permutations in iS„(123) are less likely 
to have fixed points, in part because they can have at most 2 of them, and permutations in 
iS„(231) are much more likely to have fixed points than the typical permutation in Sn- 



7.2. Proof of Theorem 7.1, Let cr G 5„(321) be chosen uniformly at random, and a' = 
{a{n), ... ,(t{1)). Since a € 5„(321), we have a' G 5„(123). For r e Sn, define afp(T) = 
#{z s.t. t(j) = n+ l — z, l<i< n}. Let afp„ : iS„(123) — Z such that afp„(r) = afp(T). Let 
fp„ : 5„(321) — >• Z such that fp„(o-) = fp(cr). By definition, we have fp„ ~ afp„. 
Clearly, 

1 " 

E[afpJ = — ^P„(fc,n + l-fc). 

Observe that 



k=i 



Pn{k, n + 1 - fc) = Ck-lCn-k 

by Lemma |4.2[ By the recurrence relation for the Catalan numbers, we have 



Y,Pnik,n + l-k) = Cn. 

k=l 

Therefore, 

E[afpJ = 1, so E[fpJ = 1. 

For the proof of the second part, let e > and a E (e, 1 — s), and define 6 = min{e, a — e}. 
Let 

P = P = i for some i E [Sn, (1 — S)n + 1]) . 
By the definition of P, we have 

P((j(i) = i for some i E /„^e(a)) < P for all n, 
so it suffices to show that P — > as n — > oo. Observe that for all n, we have 

(l-(5)n+l 

C'n 



P = ^ Pn{k,n + l~k). 



k—Sn 

By Lemma [4. 2 [ we have 

Pn{Sn, (1 - 5)n + 1) _ C5„_iC(i_5)„ 



Cn Cn 4y7r((5(l - (5)n)2 



as n — > oo. 



Observe that for d E {6,1 — 6) and for n sufficiently large, we have Pn{dn, (1 — d)n + 1) < 
P„((5n, (1 — 6)n + 1). Therefore, for n sufficiently large, we have 



P = ^ E Pn{k,n + l-k)<^-^-^^)^Pn{Sn,{l-6)n + l)^- 

Cn ^^^^ Cn 4V^(<5(l-5))2 

Therefore, P — > as n — > oo, as desired. 
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7.3. Proof of theorems |7.2| and |7.3[ We omit the proofs of the probabihties tending to 
since they are very similar to the proof of Theorem |7.1[ and instead prove the following 
proposition. 

Proposition 7.5. Let a e iS„(123) and r e 5„(132) be chosen uniformly at random. Then 

E[fp„(T)] = 1 for all n, and E[fp„(f7)] ~^ 2' o,s n ^ 00. 

Proof. Let a e 5„(123) and r e 5„(132) be chosen uniformly at random. By a bijection between 
132-avoiding and 321-avoiding permutations in l EPj (see also [CKl IRobl IRSZ| ). fixed points 
are equidistributcd between iS„(132) and iS„(321). Therefore, by the proof of Theorem 7.1 we 
have E[fp„(T)] = 1. 
Now we prove that 

E[fp„(CT)] ^, as n ^ 00. 

Observe that for all n, we have 

E[fp„(a)]^x:^#^- 

k — 1 

Let Ci and C2 be constants such that < Ci < C2 . By theorems |3.1| and |3.3[ we have 

k=n/2-C2Vn " k=n/2+Ci^/n " 

where the error term e(Ci, C2, — as Ci — >■ 0, C2 — >■ 00, and n — > 00. By the symmetry in 



Proposition |2.2[ and by Lemma |478| we have 



E[fp„(a)]^2 J2 ^^^+e(Ci,C2,n)^2 ^ ^^^e^^ + e(Ci, C2, n). 

/c— n/2 — C2^Ai /c— Ci i/n 

As Ci — ?> and C2 — > 00, we have 



E[fp„(a)] ^ 2V^ / = / 



Since 

/•OO 



00 / — 

/TT 
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we get E[fp„(CT)] 1/2, as desired. □ 



7.4. Proof of Theorem EH 



Proof. Let ct G 5„(231) be chosen uniformly at random. Observe that t = (a{n), a{n 
1), . . . , cr(l)) G 5„(132) and is distributed uniformly at random. Therefore, 



E[fp„(fT)] = E[afp„(r)] = ^ 



fc=i 



Qn{k, n + 1 — fc) 



Let Afc = Qn{k,n^ fc + 1)/C„, so E[fp„ (cr)] = X]fe=i ^fc- -l^y Lemma 5.3 and Stirling's formula, 
we have 



n/2 



E[fp„(a)]^2E 



n2 



7^ ^Trfca (n — fc) 2 



1 + E 



: CXp 



4fc(n- fc) 
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Let Bk ~ ^k,CK = jyk=K^k, and let K — ^Jn. We show that Bk ~ o(Ck). For 

k < K , we have 



E 

\r—l 



: CXp 



4:k{n - k) 



— 0{k^), since ^ 



Therefore, = 0(fc i), and 
For fc — cx) as n ^ cx), we have 



Ba: = 0(v^(%Ai)-2) = 0(n5). 



4fc(n " k) 



ki 



exp 



2 



4fc(n - fc) 



dx — 



V2T{1) (k{n-k) 



Therefore, for these values of fc, we have 



At 



V2r( 



3 



fci (n — fc) 4 



Consequently, we have 



2V2r^ . / 2v/2^r(|) \ 2r(i) 



r(!) 



As a result, we have 



ntPni^)] =Bk + Ck 



2 r 



as desired. 



□ 



8. Generalized rank and the longest increasing subsequence 

8.1. Results. For A > 0, define the rank^ of a permutation a £ Sn &s the largest integer r 
such that ct(i) > Ar for all 1 < z < r. Observe that for A = 1, we have rank^ = rank as defined 
in [EP] (see also pTllKitl V 

Theorem 8.1. Let ci, A > and < e < ^. Also, let a E 5,i(123) and r e 5„(132) be chosen 
uniformly at random. Let R\_n = rankA(cr) and 5a, n = rankA(T). Then E[i?i.„] = £[51, „] for 
all n. Furthermore, there exists a constant C2 > such that for n sufficiently large, we have 

71 1 71 

- cin^+' < E[i?A.n] < - ci-sfh. 

The following corollary rephrases the result in a different form. 
Corollary 8.2. Let A and i?„ he as in Theorem \8.1\ Then we have 

log(^-EK]) 1 

lim ^ — = -. 

n-i-oo log n 2 

For A = 1, the corollary is known and follows from the following theorem of Deutsch, 
Hildebrand and Wilf. Define lis(cr), the length of the longest increasing subsequence in a, 
to be the largest integer k such that there exist indices ii < i2 < ... < ik which satisfy 
it(zi) < (7(12) < . . . < cr(ifc). Let lis„ : 5„(321) — > Z such that lis„((7) = lis(cr). 
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Theorem 8.3 ([DHW]). Let a e 5„(321). Define 

lis„(a)-t 

^nVy) = ^ 

Then we have 

lim P(X„((t) <e) = 



where T{x,y) is the incomplete Gamma function 

rv 



Theorem 



8.3 



states that E[Us„ct] — > + Cy/n as n — > oo, for some constant c > 0. By |EP| . 
we have S'i^„ ^ (n — hs„). By Knuth-Richards' bijection between 5„(123) and 5„(132), we have 
Si^n ~ Ri,n, so E[i?i_„] = E[n — Us„]. Therefore, 

E[i?i,„] n — { — + c\/n) = — — cy^, as n — oo. 

8.2. Another technical lemma. By Knuth-Richards' bijection (also Simion-Schmidt's bijec- 
tion) between iS„(123) and iS„(132), the rank statistic is equidistributed in these two classes of 
permutations, so E[i?i „] — E[S'i „] for all n (see |CK[ IKit] ). Therefore, it suffices to prove the 
inequalities for i?A,n. 

We prove the lower bound first, followed by the upper bound. To prove the lower bound, we 
first need a lemma regarding this sum. 

Lemma 8.4. Let e > 0, Ci > 0, A > 0, n a positive integer, and i,j be integers such that 

n 



l<i<r,l<j< Ar, where r ~ - — ;— ;- — Cin2 

Then the function Pnihj) is maximized for {i,j) = (r, Xr), as n oo 
Proof of Lemma \8.4\ By reasoning similar to the proof of Lemma |4.6[ 
P„{r,Xr) {X + lfcln^'-i \ iX + l)*cln^' 



Cn 



exp 



4A 



as n — > oo. 



4A2 0r 

Let \ < i < r and 1 < j < Xr such that i + j ^ sn for some < s < 1. Then by Lemma |4.5 
there exists some < S < 1 such that 

PniiJ) 



< 6" for n sufficiently large. 



For n sufficiently large, we have 

(A + l)^c?n2^- 



<5" < 



exp 



(A + lyc jn^' 
4A~ 



4A2 ^ 

so Pn[i,j) < Pn{f,Xr) as n — > oo. 

It remains to consider l<i<r,l<j<Xr such that i + j ^ n. Since r ~ n/(X + 1), we 
need 

n Xn 

i ^ and j ~ t 

A + 1 A-l-1 

as well. Let i — n/{X + 1) — c and j = Xn/ (A + 1) — d, where 

c = a?i5+^+" and d = bn^+'+'^, 

< a, /3 < 1/2 — e, and if a = (or (3 — 0), then a > ci (or b > Xci, respectively). 
We have 

Pnihj) (A+l)3(c+d+2)2 [ (A + l)2(c+d)2- 

—3 exp 



iXi 



4An 
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by similar logic to that used in the proof of Lemma |4.6| Plugging in for c and d in the exponent 
gives 

PniiJ) (A + l)3(c + d + 2)2 r (A+ l)2(an" + 6ri'')2n2e 



Cry 



4A 2 y/Trn 2 



■ exp 



4A 



Clearly if a > or /3 > we have Pnihj) < Pn{fi At") as n — > 00. Similarly, \i a — (5 — Q but 
a + 6 > (A + l)ci, then we again have Pn{i,j) < P„(r, Xr) as n — > 00. Therefore, the function 
Pn{i,j) is indeed maximized at = {r, Xr), as desired. □ 



8.3. Proof of the lower bound in Theorem 8.1 Let e > 0, u G 5„(123), and let < Ci. 

Consider 



P{Rx.n < r), where r = — — — - cin 

A + i 



By the union bound. 



Ar 



Pn{l,j) 



By Lemma 8.4 we have 



P(i?A,n < r) < Ar 



2 Pn{r, Xr) 



and by Lemma 4.6 there exists (5 > so that for n sufficiently large, we have 

„,F„(r,Ar) ^^^,^„2 



Ar 



Cr} 



Therefore, 



and 



as desired. 



P Rx.n < 



A + 1 

E[i?A,n] > 



0. 



as n — > 00, 



A + 1 



8.4. Proof of the upper bound in Theorem 8.1 We can express E[i?A „] as 

n/(A+l) n/(A+l) , , 

E[i?A,„]= kP{Rx,n = k) = J2 ^'^ l^^-" = aTT "^') 

k=Q i-'-i ^ ^ 



fc'=0 



if we let fc' = n/(A + 1) — fc. From here, for every < a < 6, we have 



E[i?A,„] < XT! - ^ '-'P (^^- = ATI - 



< 



A + 1 



k' —a^/n 

a\fn ^ P ( i?A,ri 

k' —a\pn 



A + 1 



fc' 



Therefore, it suffices to show that for some choice of < a < &, we have 



A+1 



-h^%< Rx,„ < 



A + 1 



a\/n ) = A> 0, 



for some constant A = A{a, b, A). 
Let 



F 



X-1 

X^l' 



Let cr G 5„(123), and suppose we have 



A + 1 



, cf{i) =i + F, and = j + F. 
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Then for any r > j, we have a{r) < j + F, since otherwise a 123-pattern would exist with 
{i,j,r). However, this is a contradiction, since a : Z [j + l,n] Z D [1, j + F — 1] must be 
injective, but n — j>j + F— 1. Consequently, a can have at most one value oi i < n/{X + 1) 
with a(i) = i + F. 

Let fc' = 7T,/(A + l) — dy/n for some constant d. Then we have 

^' P„{i,i + F) 



C„ 



since X]i=i Pn{i,i + F) counts the number of values i < k' such that a{i) = i + F for some 
a e iS„(123), and each a is counted by at most one i. In the notation of Theorem 3.3 we obtain 

P(i?A.„ < fc') > ^ (aTT'O " (aTT'O n^c». 

For any d > 0, this integral is a positive constant which is maximized at d — a for d € [a,b]. 
Therefore, 

by/n < R\,n < T h a\/n ) [ V ( t , ^ ) ( t , t ) <ii as n — ^ oo. 



+ 1 ' - ■ A + 1 ' y A 'VA + 1 y VA + 1 

Denote 

b / . X / 1 



^("'''"^^AHaTT'VHaTT'T' 

For any A we can choose < a(A) < 6(A) so that A{a, 6, A) is bounded away from 0. Plugging 
back into our upper bound gives 

Tl 

E[i?A.n] < —— - a{X)A{a,b,X)V^, 
A + i 



completing the proof of the upper bound and of Theorem 8.1 



9. Final remarks and open problems 

9.1. The history of asymptotic results on Catalan numbers goes back to Euler who noticed in 
1758, that Cn+i/Cn — )■ 4 as n — )■ oo, see [Eul ] . In the second half of the 20th century, the study 
of various statistics on Catalan objects, became of interest first in Combinatorics and then in 
Analysis of Algorithms. Notably, binary and plane trees proved to be especially fertile ground 
for both analysis and applications, and the number of early results concentrate on these. We 
refer to [Ml iBPSl iDe^ IDFHNSl iDGl iFOl [GWl [Qrtl [Tak] for an assortment of both recent and 
classical results on the distributions of various statistics on Catalan objects, and to FS for a 
compendium of information on asymptotic methods in combinatorics. 

The approach of looking for a limiting object whose properties can be analyzed, is standard 
in the context of probability theory. We refer to [Al] for the case of limit shapes of random trees 
(see also [Drm, ) . and to |Verl IVKJ for the early results on limit shapes of random partitions and 
random Young tableaux. Curiously, one of the oldest bijective approach to pattern avoidance 
involves infinite "generating trees" [West] . 

9.2. The study of pattern avoiding permutations is very rich, and the results we obtain here 
can be extended in a number of directions. First, most naturally, one can ask what happens 
to patterns of size 4, especially to classes of equinumerous permutations not mapped into each 
other by natural symmetries (see |Blj ). Of course, multiple patterns with nice combinatorial 
interpretations, and other generalizations are also of interest (see e.g. |B21 |Kitl). Perhaps, only 
a few of these will lead to interesting limit shapes; we plan to return to this problem in the 
future. 

Second, there are a number of combinatorial statistics on 5„(123) and 5,i(123), which have 
been studied in the literature, and which can be used to create a bias in the distribution. In 
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other words, for every such statistic a : 5„(7r) — > Z one can study the Umit shapes of the 
weighted average of matrices 

^ g"(<") M((t) , where q > is fixed 

cre5„(7r) 

(cf. Subsection Let us single out statistic a which counts the number of times pattern oj 
occurs in a permutation a. When tt is empty, that is when the summation above is over the 
whole Sn, these averages interpolate between 5'„ for g = 1, and 5„(w) for g — > 0. We refer 
to (B3llHom] for closely related results (see also |MV1[|MV2] ) 

Finally, there are natural extension of pattern avoidance to 0-1 matrices, see jKMVi [Spi| , 
which, by the virtue of their construction, seem destined to be studied probabilistically. We 
plan to make experiments with the simple patterns, to see if they have interesting limit shapes. 

9.3. There are at least nine different bijections between 5„(123) and 5„(132), not counting 
symmetries which have been classified in the literature |CKj (see also [Kitl §4]). Heuristically, 
this suggests that none of these is the most "natural" or "canonical" . From the point of view 
of [Plj . the reason is that such a natural bijection would map one limit shape into the other. 
But this is unlikely, given that these limit shapes seem incompatible. 



9.4. The integral which appears in the expression for x{a, c) in Theorem 3.5 is not easily 
evaluated by elementary methods. After a substitution, it is equivalent to 



{z + c)i 



which can be then computed in terms of hypergeometric and Bessel functionf|^ we refer to jAS 



for definitions. Similarly, it would be nice to find an asymptotic formula for u{c) in Theorem 3.6 



9.5. Let us mention that the results in Section [3] imply few other observations which are not 
immediately transparent from the figures. First, as we mentioned in Subsection our results 
imply that the curve Qn{k, k) is symmetric for {l+e)n/2 < k < (1 — e)n, reaching the minimum 
at A; = 3n/4, for large n. Second, our results imply that the ratio 

Qnin/2 - ^,n/2 - y/n) 

— — — ^ — > 2 as n — >■ oo , 

P„(n/2- v^,n/2- V^) 

which is larger than the apparent ratios of peak heights visible in Figure [ij Along the main 
diagonal, the location of the local maxima of Pn{k, k) and Qn{k, k) seem to roughly coincide 
and have a constant ratio, as n ^ oo. Our results are not strong enough to imply this, as extra 
multiplicative terms can appear. It would be interesting to see if this is indeed the case. 

9.6. The generalized rank statistics rank^ we introduce in Section |8] seem to be new. Our 
numerical experiments suggest that for all A > and for all n, rank^ is equidistributed between 



5„(132) and 5„(123). This is known for A = 1 (see ^8.2). We conjecture that this is indeed the 
case and wonder if this follows from a known bijection. If true, this implies that the "wall" and 
the left side of the "canoe" are located at the same place indeed, as suggested in the previous 
subsection. 

Note that rank(a) < n/2 for every a E Sn, since otherwise Af(cr) is singular. Using the same 
reasoning, we obtain rankA(o') < n/(l + A) for A < 1. It would be interesting to see if there 
is any connection of generalized ranks with the longest increasing subsequences, and if these 
inequalities make sense from the point of view of the Erdos-Szekeres inequality |ESj . 



■^For more discussion of this integral, see http : //tinyurl . com/akpu5tk 
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9.7. From Lemma 4.2 it is easy to see that P„(j, /c) for j + k < n + 1, coincided with the 
probabihty that a random Dyck path of length 2?! passes though point {n—j+k — 1, n+j — k— 1). 
This translates the problem of computing the limit shape of the "canoe" to the shape of brownian 
excursion, which is extremely well understood (see |Pit| and references therein). As mentioned 
in the introduction, this explains all qualitative phenomena in this case. For example, the 
expected maximum distance from the anti-diagonal is known to be •^7rn(l-|-o(l)) (see [ChullDT] ). 
Similarly, the exponential decay oi Pn{k — t, n — k — t) for t = n^/^+^, follows from the setting, 
and seems to correspond to tail estimates for the expected maximal distance. However, perhaps 
of the emphasis on the maxima and occupation time of brownian excursions, it seems there are 
no known probabilistic analogues for results such as our Theorem |3.3[ 



9.8. Unfortunately, there seem to be no obvious way to interpret Lemma |5 . 3| probabilistically. 
One can of course, use bijections to random binary trees, but the corresponding statistics are 
not very natural. It would be interesting to find a good probabilistic model with the same limit 
shape as 5„(132). 

9.9. Let us define the following variation on the ^-squared statistic on Sn ■ 

n 

X^(cr) := r(i), where r{i) ~ mm{{n + 1 — a{i) — i)"^ , {2n — a{i) ^ i)^"^ . 
1=1 

This statistic measures how far the permutation a is from the reverse identity permutation 
(in cyclic order). Curiously, in contrast with the number of fixed points, this statistic can 
distinguish our sets of pattern avoiding permutations. 

Theorem 9.1. For defined as above and n — oo, we have: 

E[x^(ct)] — Q{n^), where cr € iS„( 123) uniform, 
E[x^(cr)] = 8(^2-5), where ct G 5„(132) uniform, 
E[x^((t)] = Q{n'^), where a £ Sn uniform. 

The remaining four patterns of length 3 have also these asymptotics by the symmetries. The 



proof of Theorem 9.1 will appear in a forthcoming thesis Min by the first author. 



9.10. After this paper was written and posted on the arXiv, we learned of two closely related 
papers. In |MLj . the authors set up a related random pattern avoiding permutation model 
and make a number of Monte Carlo simulations and conjectures, including suggesting an em- 
piric "canoe style" shape. Rather curiously, the authors prove the exponential decay of the 
probability P{t{1) > 0.71n), for random r e 5„(4231). 

In jAM| . the authors prove similar "small scale" results for patterns of size 3, i.e. exponential 
decay above anti-diagonal and polynomial decay below anti-diagonal for random a e 5„(132). 
They also study a statistic similar but not equal to rank. The first author surveys these results 
and explores the connections in [Mm]. 
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10. Appendix: Numerical calculations 
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Figure 7. Values of Pe2ik,k). 



ODSO ■ 
0.025 ■ 













0020 






0.015 
Q.010 ■ 






0.005 ■ 






0.000 







Figure 9. Values of P25o(fc, k). 




Figure 8. Values of Pi25(fc,fc). 
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Figure 10. Values of F5oo(fc, fc). 





Figure 13. A closer look at 
P25o(j,fe), 201 < J + fc < 301. 



Figure 14. A closer look at 
Q25o(i,fc), 201 <i + fe < 301. 



